Batch Means and Spectral Variance Estimators in Markov Chain Monte Carlo
نویسندگان
چکیده
Calculating a Monte Carlo standard error (MCSE) is an important step in the statistical analysis of the simulation output obtained from a Markov chain Monte Carlo experiment. An MCSE is usually based on an estimate of the variance of the asymptotic normal distribution. We consider spectral and batch means methods for estimating this variance. In particular, we establish conditions which guarantee that these estimators are strongly consistent as the simulation effort increases. In addition, for the batch means and overlapping batch means methods we establish conditions which ensure consistency in the mean-square sense which in turn allows us to calculate the optimal batch size. Finally, we examine the finite sample properties of spectral variance and batch means estimators in the context of some examples and provide recommendations for practitioners.
منابع مشابه
Strong Consistency of Multivariate Spectral Variance Estimators in Markov Chain Monte Carlo
Markov chain Monte Carlo (MCMC) algorithms are used to estimate features of interest of a distribution. The Monte Carlo error in estimation has an asymptotic normal distribution whose multivariate nature has so far been ignored in the MCMC community. We present a class of multivariate spectral variance estimators for the asymptotic covariance matrix in the Markov chain central limit theorem and...
متن کاملEstimating standard errors for importance sampling estimators with multiple Markov chains
The naive importance sampling estimator based on the samples from a single importance density can be extremely numerically unstable. We consider multiple distributions importance sampling estimators where samples from more than one probability distributions are combined to consistently estimate means with respect to given target distributions. These generalized importance sampling estimators pr...
متن کاملJudging Mcmc Estimators by Their Asymptotic Variance
The expectation of a function can be estimated by the empirical estimator based on the output of a Markov chain Monte Carlo method. We review results on the asymp-totic variance of the empirical estimator, and on improving the estimator by exploiting knowledge of the underlying distribution or of the transition distribution of the Markov chain.
متن کاملAdaptive Markov Chain Monte Carlo Confidence Intervals
In Adaptive Markov Chain Monte Carlo (AMCMC) simulation, classical estimators of asymptotic variances are inconsistent in general. In this work we establish that despite this inconsistency, confidence interval procedures based on these estimators remain consistent. We study two classes of confidence intervals, one based on the standard Gaussian limit theory, and the class of so-called fixed-b c...
متن کاملKernel Estimators of Asymptotic Variance for Adaptive Markov Chain Monte Carlo
We study the asymptotic behavior of kernel estimators of asymptotic variances (or long-run variances) for a class of adaptive Markov chains. The convergence is studied both in L and almost surely. The results apply to Markov chains as well and improve on the existing literature by imposing weaker conditions. We illustrate the results with applications to the GARCH(1, 1) Markov model and to an a...
متن کامل